Grouped variable selection for generalized eigenvalue problems
نویسندگان
چکیده
Many problems require the selection of a subset variables from full set optimization variables. The computational complexity an exhaustive search over all possible subsets is, however, prohibitively expensive, necessitating more efficient but potentially suboptimal strategies. We focus on sparse variable for generalized Rayleigh quotient and eigenvalue problems. Such often arise in signal processing field, e.g., design optimal data-driven filters. extend generalize existing work convex optimization-based using semidefinite relaxations toward group-sparse ℓ1,∞-norm. This group-sparsity allows, instance, to perform sensor spatio-temporal (instead purely spatial) filters, select based multiple eigenvectors instead only dominant one. Furthermore, we extensively compare our method state-of-the-art methods filter simulated network setting. results show both proposed algorithm backward greedy best approximate solution. However, has specific failure cases, particular ill-conditioned covariance matrices. As such, is most robust currently available
منابع مشابه
A New Inexact Inverse Subspace Iteration for Generalized Eigenvalue Problems
In this paper, we represent an inexact inverse subspace iteration method for computing a few eigenpairs of the generalized eigenvalue problem Ax = Bx [Q. Ye and P. Zhang, Inexact inverse subspace iteration for generalized eigenvalue problems, Linear Algebra and its Application, 434 (2011) 1697-1715 ]. In particular, the linear convergence property of the inverse subspace iteration is preserved.
متن کاملBayesian Grouped Variable Selection
Traditionally, variable selection in the context of linear regression has been approached using optimization based approaches like the classical Lasso. Such methods provide a sparse point estimate with respect to regression coefficients but are unable to provide more information regarding the distribution of regression coefficients like expectation, variance estimates etc. In the recent years, ...
متن کاملa new inexact inverse subspace iteration for generalized eigenvalue problems
in this paper, we represent an inexact inverse subspace iteration method for com- puting a few eigenpairs of the generalized eigenvalue problem ax = bx[q. ye and p. zhang, inexact inverse subspace iteration for generalized eigenvalue problems, linear algebra and its application, 434 (2011) 1697-1715 ]. in particular, the linear convergence property of the inverse subspace iteration is preserved.
متن کاملGrouped Orthogonal Matching Pursuit for Variable Selection and Prediction
We consider the problem of variable group selection for least squares regression, namely, that of selecting groups of variables for best regression performance, leveraging and adhering to a natural grouping structure within the explanatory variables. We show that this problem can be efficiently addressed by using a certain greedy style algorithm. More precisely, we propose the Group Orthogonal ...
متن کاملA flexible shrinkage operator for fussy grouped variable selection
Existing grouped variable selection methods rely heavily on prior group information, thus they may not be reliable if an incorrect group assignment is used. In this paper, we propose a family of shrinkage variable selection operators by controlling the k-th largest norm (KAN). The proposed KAN method exhibits some flexible group-wise variable selection naturally even though no correct prior gro...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Signal Processing
سال: 2022
ISSN: ['0165-1684', '1872-7557']
DOI: https://doi.org/10.1016/j.sigpro.2022.108476